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Abstract 

We consider a deformation of the BF theory in any dimension by means of the an- 
tifield BRST formalism. Possible consistent interaction terms for the action and the 
gauge symmetries are analyzed and we find a new class of topological gauge theories. 
Deformations of the world volume BF theory are considered as possible deformations of 
the topological open membrane. Therefore if we consider these theories on open mem- 
branes, we obtain noncommutative structures of the boundaries of open membranes, and 
we propose a generalization of the path integral representation of the star deformation. 



* E-mail address: ikeda@yukawa.kyoto-u.ac.jp 



1 Introduction 



Kontsevich has given a general formula for the deformation quantization jl] of functions 
on the Poisson manifold in the paper 0. Cattaneo and Felder |3j have obtained the path 
integral representation of that formula on the Poisson manifold as a perturbative expansion 
of a two-dimensional field theory on two-dimensional disk. The star product structure in the 
open string theory with non-zero background Neveu-Schwarz B-field appears essentially at 
the same mechanism ||. 

The world sheet field theory in the paper || is called a nonlinear gauge theory or the 
Poisson sigma model in two-dimension [0] @ . It is one of Schwarz type (or BF type) topological 
field theory [7j and has the gauge symmetry, which is a generalization of the usual nonabelian 
gauge symmetry. 

Izawa H has recently analyzed the nonlinear gauge theory from the viewpoint of a defor- 
mation of the gauge symmetry ||. He has found that two-dimensional nonlinear gauge theory 
is the unique consistent deformation of two-dimensional abelian BF theory. The author has 
made the similar analysis in three dimension pi I He has considered the abelian BF theory in 



three dimension and all their possible deformations which action has the ghost number zero, 
and has found the new topological gauge theory. In this paper, we make a similar analysis 
in any dimension. We consider the abelian BF theory and analyze all deformations by the 
antifield BRST formalism. 

We consider the two-dimensional theory as a survey of our story. First we consider the 
following action of the abelian BF theory in two dimension: 



So = J Co, C = B a d(p a , 



where a, b, etc. are Lie algebra indices (or the target space indices). <p a is a scalar field, B a is 
a one-form gauge field. This theory has the following abelian gauge symmetry: 

5 B a = de a , 5o(t) a = 0. (2) 

Of course, the commutation relation on the scalar field <fi is [0 a , <p b ] = and correlation 
functions of arbitrary functions of are simply products of one-point functions. 



deformation of the BF theories has analyzed in a special case by Dayi ITll] 
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Here we find all the consistent interactions with the free action (^]) up to field redefinition 
as a local field theory in two dimension with the aid of Barnich-Henneaux method in terms 
of the BRST cohomology based on the antifield (Batalin-Vilkovisky) formalism. We use 
the BRST formalism to deform the world sheet theory, in order to realize the "physical 
requirement". In the papers ||, they have required locality, unitarity and gauge invariance of 
the deformed action and have given a method to analyze the BRST cohomology and obtained 
all deformations of the gauge theory. 

The answer in two dimension is 

S = Jc, £ = B a d<p a + ^W ab B a B b , (3) 

under the assumption that the ghost number of the action is zero, where W ab (4>) = — W ba (4>) 
is an arbitrary function of <p a |J. The gauge symmetry is deformed to the nonlinear gauge 
symmetry: 

dW bc 

5 Nh B a = de a + -QT^B b e c , <W a = W ba e b , (4) 

where W ab {4>) must satisfy the following identities: 

dW ab j dW bc A dW ca M 

_ W - + _ W - + _ Iy - = , (5) 

in order for (|4]) to be a symmetry of the theory. This Eq.@ is just the Jacobi identity if the 
following commutation relation holds: 

[r,<P b } = w ab (<p). (6) 

The commutation relation on the left hand side is realized as the Poisson bracket of the 
coordinates <p a and <p b on the Poisson manifold |1. If we consider the theory on the two- 
dimensional disk, the correlation functions at the boundary of the disk of arbitrary functions 
of are deformed to the star product F * G under the appropriate regularization and the 
appropriate boundary condition ||. 

Recently, noncommutative geometry are widely used to analyze the string theory. If we 
consider the open string theory with the constant background NS B-field, the noncommu- 
tative geometry appears on the D-brane ||]. The generalization of the star product to the 
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nonconstant B- field has been anlayzed in [p!2[ . Some authors have analyzed generalizations 
of this theory to the higher dimension. Noncommutative geometry appears at the boundary 
of open 2-brane in M-theory fll3| 1 i~4| |i~5|] . In this paper, we propose one approach to analyze 
them. We consider that deformations of the world volume BF theory lead us to deformations 
of the boundaries of the topological open n — 1-brane, where n — 1 is the space dimension 
of the membrane. In fact, the star deformation formula is derived from the deformation of 
two-dimensional BF theory as the world sheet theory. 

Deformations of the topological open string have been analyzed in pl |. Deformations of 



the topological open membrane in three dimension have been analyzed in [23]. We will 
obtain a generalization of the path integral representation of the star deformation formula. 
However analysis of deformations of the BF theories are not still completed. In this paper, 
we analyze deformations of the BF theory. 

This paper is organized as follows. In section 2, we construct the superfield antifield 
formalism of the abelian BF theory. In section 3, we analyze deformations of the abelian BF 
theory and obtain all possible deformations. In section 4, we consider two examples of our 
theory in the lower dimensions. In section 5, we consider the quantum BV formalism and 
quantize the theory. In section 6, we analyze the topological membrane action. Section 7 is 
conclusion and discussion. 



2 The Superfield Formalism for the Batalin-Vilkovisky 
Action of the Abelian BF Theory 

First, we consider the following n-dimensional abelian BF theory: 

So = £ / a dA p a , (7) 

where A p a is a p-form gauge field and 5 n _ p _i s is a n - p — 1 form auxiliary fields. Indices 
a, b, c, etc. represent algebra indices. £ is a base manifold on which the theory is defined. The 
sign factors (— l) n ~ p are introduced for convenience. This action has the following abelian 
gauge symmetry: 

<y„v = dc % 
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8oB n -p-l a — dt^-p-^a, (8) 

where c^ll is a p — 1-form gauge parameter and t^Z^Z^a is a n — p — 2-form gauge parameter. 
(p) in c p P l\ and (n — p — 1) in t^^Jpa represent that c p p ll is a gauge parameter for p-form 
A p a and t^-p-^a is one for n — p — 1-form fi n _ p „i a , respectively. This gauge symmetry is 
reducible. Since A p a is a p-form and -B„_ p _i a is a n — p— 1-form, we need the following towers 
of the 'ghost for ghosts' to analyze the complete gauge degrees of freedom: 

X A a _ r l r .(p) a X f> _ jAn-p-l) 

°0^p — OO-Dn-p-l a — tit n _p_2 a , 

X Jp) a _ jJ.P) a X An-p-1) _ j.{n-p-l) 

OOL-p-1 — UC p _ 2 , Oot„„p_ 2 a ~ ai n-p-3 a) 

X r .(.P) a — rlJ.P) a X An-P-1) _ iAn-p-1) 

CoCi — «c , o t 1 a — at a , 

5o4 P)a = 0, 5 tt p - 1] = 0, (9) 

where cf^ a are i-form gauge parameters and t^ a p ^ are j-form gauge parameters, i = 
0, • • • , p — 1 and j = 0, • • • , n — p — 2. 

We write the theory by the antifield BRST formalism. First we take c {p)a to be the FP 
ghosts i-form with ghost number p — i, and tf' a p ^ to be a j-form with the ghost number 
n — p — 1 — j. As usual, if the ghost number is odd, the fields are Grassmann odd, and if 
ghost number even, they are Grassmann even. 

Next we introduce the antifields for all the fields. Let $ + denote the antifields for the field 
$. Note that the relations deg($) + deg($ + ) = n and gh($) + gh($ + ) = —1 are required, 
where deg(<3>) and deg($ + ) are the form degrees of the fields $ and $ + and gh($) and gh(<3> + ) 
are the ghost numbers of them. For A p a , we introduce the antifield A^-p a , which is n — p- 
form with the ghost number —1. For _B n _ p _i a , B^^^ 1 ^ , which is p+ 1-form with the ghost 
number —1. For c^ a , c^-i a , which is n — 2-form with the ghost number — p — 1 + i. For 
t ( f'~ p ~ 1 \ t^ij ~ p ~ 1 - )a ) which is n — j-form with the ghost number — n + p + j. 

For functions $ + ) and G , ($, $ + ) of the fields and the antifields, we define the an- 
tibracket as follows; 

( F G ) = El_lSL _ (_!)(»+!)*** ~$ G m 
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where d / dip and d / dip are the right differentiation and the left differentiation with respect 
to (p, respectively. The following identity about left and right derivative is useful: 

dcp 6(p 
If S, T are two functionals, the antibracket is defined as follows: 

(ST)= [ ( ^-ll - ) (12) 

The antibracket satisfies the following identities: 

(F,G) = — ( — l)( dc S F -<KdegG-n)+(ghF+l)(ghG+l)^ p\ 

(F, GH) = + (-l) (dogF " n)degG+(ghF+1)shG G(F,if), 

(FG, H) = F(G,H) + (_l)dcgG(d e gH-n) + ghG(ghH+l)( F;iJ ) G! 

(_ 1 )(degF-n)(degH-n)+(ghF+l)(ghi/+l)( Fj ^ R ^ + permutations = Q, (13) 

where F, G and H are functions on fields and antifields. 

In order to simplify notations and calculations, we rewrite notations by the superfield 
formalism. We combine the field, its antifield and their gauge descendant fields as superfield 
components. For A p a and _B n _ p _i a , we define corresponding superfields as follows: 

A a — Sv)a. _| (p)o | | Jp)a . a R +(n-p-l)o 

— t-0 ~r c l ~r ' * * T L-p_i ~T rip ~r -Op+l 

,,+(n-p-l)a + +(n-p-l)a 
' L p+2 t ■ • • T h n , 

f* _ An-p-1) ,,(n-p~l) ,(n-p-l) , □ i 4+(p) 

a n— p— 1 a •'O a ~r a ~r " " ' r t n _p_2 a T D n-p-l a ~r ^n— p a 

+ C n-p+l a + ' ' ' + C n^a > ■ (l^) 

Then we define the total degree \F\ = ghF + degF. The component fields in a superfield have 
the same total degree. The total degrees of A p a and _£? n _ p _i a are p and n—p — 1, respectively. 
We take a notation • as the dot product among superfields in order to simplify the sign 



factors [16|. The definitions and properties of the dot product are in the appendix. The dot 



antibracket of the superfields F and G is defined as 

((F,G)) = (_l)(ghF+l)(degG-n)(_ 1 )gh$(deg*-n)+r l ( F)G( ^ ^ 
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Then the following identities are obtained from the equations ([13]) and (Jq) : 

{(F,G)) = _(_l)(l^l+l-«)(l«l+l-n)(( G) F )) ; 

((F, Gtf )) = ((F, G)) -H+i-lY^-^G-iF, H)), 
((FG,H)) = F.((G,H)) + (_i)l«KI^I+i-)(( F , H )) ■ G, 

(( G , if )) )) + cyclic permutations = 0. (16) 

We define the dot differential as 

d<p K } dip' 

F~ = (_i)s h ^ de g^^-. (17) 
dip dip 

Then, from the equation (|TT1), we can obtain the formula 

= (18) 

dip dip 

Since and B n - P ^i a are the field-antifield pair, we can rewrite the BV antibracket on two 
superfields F and G from ( [TDD and QT5D as follows: 

((f> <?)) = ' J'f ■ • Qg—— ■ G ~ (-l) np F ■ Qg—— ' gJH ' G - (19) 

p=0 UJi p ur> n—p—\ a ur> n-p-l a UA p 

We can construct the Batalin-Vilkovisky action for the abelian BF theory by the superfields 
as follows: 



[ n— 1 
~2~ 



S o = E / (-l) n - p S n _ p _! • cM/, (20) 
p=0 ,/s 

where we integrate only n-form part of the integrand. If we set all the antifields zero, (|20"D 
reduces to (0). The BRST transformation for the superfield F under the action above is 
defined as 

^H(So,F)) JjV^-^^-F^ (21) 

p=Q u - t *-p US3 n—p—\ a UD n —p—\ a UJ\p 
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Hence the BRST transformations on A p a and -B n _ p _i a are obtained as follows: 

M P fl = ((S , A p a )) = (-l) n - p 9 -S 
= dAp , 

8 B n _ p _i a = ((S Q , B n - p _i a )) = ( — - • 

(22) 



If we expand the BRST transformations (p2|) above to the components by (|14D , we can obtain 
the BRST transformation on each field and antifield as follows: 

5 c { t = 0, 
8 c? a = dc { t, 



SoCp P li — dCp P }_2-, 
$oAp = dc p p li, 

6oB +in- P -l)a = dA/ ^ 

r ,+(n-p-l)o _ i R +(n-p-l)a 
°0 l p+2 — an p+l ) 

r ,+(n-p-l)a _ T,+(n-p-l)a 
"0^+3 — at p+2 ) 



r f +(n-p-l)a _ j±+{n-p-\)a 
°0 l n — al n-l > 

r (n-p-1) _ n 

r , (n-p-1) _ ,,(n-p-l) 
"Oh a — ai a j 

r , (n-p-1) _ ,,(n-p-l) 
UQL n _p_ 2 a — «t n _ p _3 a , 



OO-Bn-p-1 a — dt 



(n-p-1) 
n— p— 2 a 5 



"O-^-n— p a u,J -'n— p— 1 a? 

(J L 'n-p+l a ~~ "^n-p a) 

X _+(p) _ J_+(l>) 

u u n— p+2 a "Wi— p+1 a) 
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5o4V = dc^> a , (23) 

which reproduce the gauge transformations (|9]). 
So must be BRST invariant. In fact, 

5 S = &S ,S )) = 2J2 (-l) (n ' p) / d(B„- P -i a ■ dA p a ) 

[2=1] 

= 2 £ / dCdBn-p-ia-V): ( 24 ) 

therefore if the base manifold £ has no boundary, <5oSo = 0. If £ has a boundary (For example, 
the open string or the open membrane.), we can take two kinds of boundary conditions 
A p a ,/\dY, = or B n _ p _i //|as = 0, where the notation // mean the components along the 
direction tangent to the boundary <9£. We can also take the different boundary condition on 
each field component so as to satisfy BRST invariant condition of the action. Two boundary 
conditions are used to construct A, B and C boundary conditions in the paper p2| . In the 



rest of this paper, we select appropriate boundary conditions so as to satisfy 5 S = 0. 
It is simple to confirm Sq = on all superfields. Equations of motion are 

dA P a = 0, dB n ^ a = 0. (25) 

3 Deformation of BF Theory 

Let us consider a deformation of the action So perturbatively, 

S = S + gS 1 + g 2 S 2 + ---, (26) 

where g is a deformation parameter, or a coupling constant of the theory. The total BRST 
transformation is deformed to 

5A p a = ((S, A p a )) = (-l) n - p RTi 9 ■ S, 

5B n ^ a = ((S, B n _p^ a )) = (-1)^) . S. (27) 

In order for the deformed BRST transformation 5 to be nilpotent and make the theory 
consistent, the total action S has to satisfy the following classical master equation: 

((S,S)) = 0. (28) 
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Substituting to (p^), we obtain 

(( 5 , 5)) = ((So , S„ )) + 2g(( S ,S 1 )) + g 2 [(( S 1 ,3,)) + 2(( S , S 2 ))] + 0(g 3 ) = 0. (29) 

We solve this equation order by order. At the 0-th order, we obtain 5 So = (( So , So )) = 0, 
which is already satisfied from (p4|). At the first order of g in the Eq. (|29|) , 



6oS 1 = {(So,S 1 )) = 0, (30) 
is required. Now we assume that Si is given by a local Lagrangian: 

Si = / A, (31) 



where L\ is constructed from the superfields A p a and B n _ p _i a with p = 0, • ■ ■ , [^^-J- If 
a monomial in C\ includes a differentiation d, its term is proportional to the equations of 
motion (p5|). Therefore its term can be absorbed to the abelian BF theory action ( p0[ ) by 
the local field redefinitions of A p a or B n _ p _ 1 a , and that term is BRST trivial at the BRST 
cohomology||. Hence the nontrivial deformation terms must not include the differentiation 
d and we can write the candidate £i as 

Si = Ci, 
Jt, 

£l = X/ F pi ... Phtqi ... qi ai-a k 1 '(^0 ) "^pi 1 " " "^p fc * 'Bqibi ' ' 'Bqibp (32) 

pi)— ,Pk,n,— ,qi 

where F pv .. Ph>qi ... qi ai ... ak bv " bl (A a ) is a function of A a , and p r ^ 0, g s ^ for r = 1, • • • , k, s = 
!,•••,/. In order to consider the general deformations, we do not require the total degree of 



Ci is n. Then (|30|) is calculated as follows: 



<5oSl — ^2 [dFp 1 ... Pk , qi ...q l ai-a k bl & ' " ^pi" 1 ' ' '^Pfe"* ' Bqih ' ' ' B qih 

pi,-,Pk,qi,—,qt 

k 

_1_ V~Y — 1 \Pl-\ hPr-l p bl " bl ( An a \ ■ A a ^...rlA ar ■ ■ ■ A ak ■ R l ...Ft i 

' Z_^\ L ) x Pi— Pk,qv U °l— a fc V^O ; ^pi u^p r -^p fc ^gi&i "qih 

r=l 

_|_ ^(_]^PH l-Pfe+9iH 

s=l 

v F 6i—6j (4 . A ai . . . A a k . r> . . . rlR , . ■ ■ Ft 

S\-L T11 -'TiL «n ■■■/77 rn ■■■(7.1. / "^Pfc q\bt u**-*n n h n n 



^ / ^[-^pi --Pfc,gi --9i oi-a fc 1 '(^0 ) "^pi 1 ' " '-Ap fc * 'Bqibi • ' '-^gi&i]) (33) 



Pl)-,Pfc)9l.-)9l 
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and 5q Si = if 

(Fpv-P^-* ai -a k bl - bl (A a ) -A Pl <* ■ ■ -A p ^.B qibl ■ ■ -B^z/Ibe = 0. (34) 

Si must be constructed from the terms which satisfy the requirements above. If there is no 
boundary, there is no restriction for Si. If we take the boundary condition A p a //las = 0, then 
(P^) is satisfied if the terms include at least one A p a . If we take £? n _ p _i a //|a£ — 0, then fl3"l|) 
is satisfied if the terms include at least one £?„_ p _i a . 
At the second order of g, 

((Si,Si)) + 2((S ,S 2 )) = 0, (35) 

is required. We cannot construct nontrivial S 2 to satisfy (|35|) from the integration of a 
local Lagrangian, because <5o-BRST transforms of the local terms are always total derivative. 
Therefore if we assume locality of the action, S 2 is a BRST trivial and we can set Sj = for 
i > 2. Then the condition ( pop reduces to 

((Si,S!)) = 0. (36) 

This imposes the identities on the structure functions F Pl ... Pkqi ... qi ai ... ak bl "' bl (Ao a ) in d32|). Now 
we have obtained the possible deformations of the BF theory in any dimension as 

S = S + gSi, (37) 



where So is ( BP ) and Si is defined as (|32p. In the next section, we consider two nontrivial 
examples. General algebra structure underline the antifield BRST formalism is the Loo-algebra 
(the sh Lie algebra) [T7]][[n| which is derived from the analysis of the master equation. The 
gauge symmetry in our theory generally has extended structures of usual Lie algebra, and if 
a deformation satisfies the master equation (p8l), that is, (|36|), the symmetry of the deformed 
theory generally has Loo-algebra structure. 

The total BRST transformations 5 for the superfields are as follows: 

5A p a = (-l) n -%S,A p a )) 

= d A p a +(-ir^ — 9 -Si, 

5B n ^i a = (-lf^((S,5 n _ p _ la )) 

= dB n ^i a + {-lf^^- a -Si. (38) 
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Equations of motion are obtained as 

dAp a + ( _ ir - P _]! Sl = Q} 

dB^p-i a + (-l) p(n_p) ^r •5'a = 0, (39) 
If we set all antifields $ + = in ([26|), we obtain the usual classical action. 

4 Examples in The Lower Dimensions 

In this section, we consider some nontrivial examples of the deformations in the lower dimen- 
sions. For simplicity, we only consider the action which total ghost number is zero. 
In two dimension, (|26|) is written as 



S — Sq + gSi, 

S = [ B la • # a , 5-1 = / ~f ah m ■ Bi a ■ B lb , (40) 

where <f> a = A a and \f ab {^ a ) = F t u(Ao a ). The condition (|36|) imposes the following identity 
on f ab : 

fi -fab f) fbc a fca 

^ f cd + ?J_ fad + W_ fbd = Q (41) 

d<i> d d<f> d d<f> d K J 

We find that this theory is nothing but two-dimensional nonlinear gauge theory (the Poisson 
sigma model) H0. We have deformed the abelian BF theory So to S by the analysis of the 
BRST cohomology. If we relax the condition that the action has ghost number zero, we can 
generalize the theory to the polyvector fields, and we obtain Loo-algebra by the deformation 
of the abelian BF theory. 

Next, we consider the theory in three dimension. We restrict Si to the ghost number zero 
for simplicity again. Then the total action (|26|) is deformed as follows: 



5 — Sq + gS±, 

S = Jj L -B 2a -d4> a +B la -dA 1 % 

6 = jf d 3 9d 3 x[f la \<t>) ■ A 1 a ■ B 2b + f?(4,) ■ B 2a ■ B lb + ^/ 3a6c (*) ■ A x a ■ A x b ■ A 1 C 
+^Uab c (<f>) ■ A x a ■ A x h ■ B lc + l -h a bc {4>) ■ AS ■ B lb ■ B lc + y, abc {4>) ■ B la ■ B lb ■ 5 lc |42) 
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where we replace the notations as fi a b = F lj2a b , ff = F ,2i ab , ^habc = ^ni.obc \fiab c = 
F\iAab c , \f5a bc = ^i,iia 6c > ~^J§ abc = ^,111*) for clarity. The condition of the classical master 
equation (|36|) imposes the following identities on six /j's, i — 1, • • • , 6: 

he a f2 b£ + f2 a£ he b = 0, (43) 

d fi a 3 ' fib a 

flb £ -Q^rf\c + fle a fibc e + f2 ae fzebc = 0, (44) 

a £ ac ftf a 

-hf-jjzr + h"-j£r + he a hb ec - f2 ae heb c = 0, (45) 

a £ ac Q £ ab 

r eb J 2 £ ec J 2 , £ a rebc < r ae r be n I AR\ 

J 2 TuTe J 2 a Te + J le h + J 2 J 5e ~ U ' v 4C v 



fl[a -qT b f2 £ -QT e + fie[a fabcf + f3e[abfbc] & ~ 0, (47) 

, cd r f)f, , d ] 



d(j) e 12 8(j) e 

r e^f^b] p e \ c dfi.ab . p p e cd i £ \d £ c]e i £ e £ cd n (a 

Jl[a ~QAe. ' ■* 2 Q^e <~ J3eabJ6 + JAe[a J 5b] + Jiab J5e — U, U 

a £ bed a £ cd] 
£ e u J6 £ e\b u J5a . p \b p cd]e , £ \bc £ d\e _ n 
Jla TZ J2 TZ r J4ea h + J5e J5a ~ U 



(49) 

ucp" ucp- 

h e[aJ ^ + h e[ab he cd] = 0, (50) 

fl[a & • + fi[ab e hcd]e = 0, (51) 

where [• • •] on the indices represents the antisymmetrization for the indices. For example, 
®[ab] — &ab — &ba- We find that the action (|42| ) with (|43|)-(|5T]) is the same theory constructed 



in the paper JT0[, and a nontrivial consistent deformation of the three-dimensional BF theory. 
If E has boundaries, possible terms are restricted according to the boundary conditions, which 
are discussed in section 3. 



5 Quantum BV formalism 
5.1 Quantum Master Equation 

In this section, we consider the quantum theory. We introduce the Hodge dual fields of the 
antifields $* a = *<3> +a . We define the BV Laplacian as follows: 

A BV F = E(- 1 ) gh *° ri F > (52) 
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where and are differentiations with respect to coefficient functions of the forms. Then 
the following identity is satisfied: 

A BV (FG) = (A BV F)G + (-l) shF+ndesF dv(F, G) + (-l) ghF FA BV G, (53) 

where dv is the volume form on S. 

In order for the generating functional to be gauge invariant, The following quantum master 
equation is required: 

(S, S) - 2ihA BV S = 0, (54) 

for the quantum action S. O is an observable if an operator O satisfies the following equation: 

{S, O) - ihA BV = 0. (55) 

If we define an operator f2 BV as Q BV = S — ihA BV , then ( |55D is denoted as Q bv O = 0. In our 
BF theory, we can confirm A BV S = 0, therefore the quantum master equation ([54]) becomes 

{S, S) = 0. (56) 

Let us rewrite the above formulae on the superfields. We define the dot BV Laplacian on 
the superfield as follows: 

AF = (-l) degF -"A BV F, (57) 
Then identity (|53|) is rewritten as 

A(F ■ G) = (AF) ■ G + (-l) (rt+1)|F| cH F,G)) + (-1) |F| F • AG, (58) 
The quantum master equation ([54]) is rewritten as 

{{S , S)) -2thAS = 0, (59) 
and the observable condition fl55|) of an operator O becomes 

((S, O)) -ihAO = 0. (60) 
We define that fl BV — S — ihA, then (|60| ) is written as il sv O = 0. (^) becomes that 

as, s)) = o. 
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5.2 Gauge Fixing 



In order to quantize the gauge theory, we must fix the gauge. We introduce the new fields; 
Fadeev- Popov antighosts and Lagrange multiplier fields (Nakanishi-Lautrup fields). Since A p a 
has the p-th order reducible gauge transformation, the following many antighosts and NL- 
fields are needed |T{||2(J. We introduce antighost and NL- field pairs, c 



p-l-L a dnu U p-1-L a 



where k = 0, 2, 



and Cp_l°i L and bp_l°i L where k 



1,3, 



L-l 



+ 1 at the L-th 



reducible order, where L = 0, p — 1. The four kinds of fields are all p — 1 — L-forms. 



c p-1-l a nas the ghost number k — L — 1, b^l_ L a has the ghost number k — L, c^f("i L has the 
ghost number L — k, and b k p ^_L nas the ghost number L — k + 1. Moreover we introduce the 



<Mp) 



k(p)a 



antifields for the fields above as c^*~+" +i and 6^^" +L , where fc = 0, 2, • - • , 2 



+k(p) 
C n— p+l+L a 



and &£JJ 1+£ a , where fc 



1,3, 



L-l 



+ 1. The form degrees and the ghost numbers of the 



antifields are determined from the relations deg($) + deg($" 



For B n _ p _i a , we also introduce antighost and NL-field pairs as p -2-l an d s n-p- >-i ■ 



n and gh($) +gh($ + ) = — 1. 

-k(n— p— l)a 



where k 



0,2,-.., 2 



, and C" p -2-i a and C-p-2-i, a, where fc = 1, 3, • • • , 2 



k(n— p— 1) 



L-l 



at the L-th reducible order, where L = 0, 1, • • • , n — p — 2. The four kinds of fields are all 



n 



P 



L-forms. t 



k(n—p—l)a 



n-p-2-L nas the ghost number k — L — 1, s^2 p -2-L nas the gh° s t 



number k — L, t^™^ 2 -L a nas the ghost number L — k, and s^lL^J^ a has the ghost number 



L — k + 1, We introduce the antifields for the fields above, tl^+L a an d Sp+^+x't/''"; where 
k = 0,2, 



^+fc(n— p— l)a 



i i+fc(n— p— l)a 1 — +fc(n— p— l)o i t 

and ^p+2+L and s p+2+l > where k 



L-l 



+ 1. 



1,3,--, 2 

We define the extended BV action including the antighosts and NL-fields as S 
where 



r n — 1 

I 2 



p-1 p-1 

E( E E 

p=i 



fc( P ) 



-+k{p)a ik(p) 



c n-p+l+L u p-l-L a 



k=o L=k 

k even 



p—1 p—X 

+ E E( 

k=i L=k 

k odd 



\c k ^t L \+K P ) 



C n-p+l+L aPp-l-L 



E 

p=0 



n— p— 2 n—p—2 

E E (- 

L=fc 



4 V'-T-2-tlf+ fc (--P-l)^(n-p-l)a 
J-J >+2+L a 6 n-p-2-L 



fe=0 

fc even 



n—p—2 n—p—2 

+ E E ( 

L=fc 



l*lr_T-^ J f +*(n-p-l)a *(»-*-!) 



■1) 1 "-P-2--L a 1 ^ 



P+2+L 



'n— p— 2— L a 



k=0 
k odd 



(61) 
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Then the BRST transformations of the fields are calculated from the antibrackets as follows: 

X^(P) _ ZHp) rl*(p) _ n 

0C p-l-L a — U p-1-L a; 0U p-l-L a ~ U ) 

c k(p)a _ h k{p)a Ah k ^ a — n 

0C p-l-L — °p-l-Li 00 p-l~L — u 5 

cTk(n-p-l)a _ -k{n-p-l)a r-k{n-p-l)a _ n 

ol n-p-2-L — b n-p-2-L 1 ub n-p-2-L ~ U 5 

r,/s(n-p-l) _ fc(n-p-l)a <- fc(n-p-l) _ n / fi9 x 

ol n-p-2-L a ~ b n-p-2-L a' ob n~p-2-L a ~ u - l uz J 

We take the boundary condition as a constant at the boundary for antighosts, and as zero at 
the boundary for NL-fields. Now we fix the gauge as follows: 

*Sgf = S + >S aux | -jf , (63) 

where \I/ is a gauge fixing fermion which is a function of the fields $ with ghost number — 1. 
For example, if we take the Landau gauge, the gauge fixing fermion is 

rn-li 



2 J p— 1 L p— 1 £ 



* = £ / ^*v + £ £ «<* * + E E ^ 

p=l L=l *=o L=l fc=i 



fe even 



n— p— 2 L 

r{n—p—l)a 7 R _ \^ \^ 7*(n-p-l)a , .fc-l(n-p-l) 



L=l fe=o 

fc even 



n— p— 2 L 

+ E E rf * tH-i^fel a, (64) 



L=l fc=i 

fe odd 



where * is the Hodge star operator. 

5.3 Observables and a generalization of the star product 

According to the discussion of the section 3, we can take two kind of boundary conditions (i) 
^p a //|<9£ = an d (ii) B n _ p _i a ,/|as = consistently. We analyze the total BRST transfor- 
mations (^) of the fields under each boundary condition. If we take (i), the terms include at 
least one A p a . The total BRST transformation of A p a at the boundary is as follows: 

(^W/las = dA p a u \ d ^. (65) 

On the other hand, if S\ has no terms which include only one A p a , 5B n ^ p ^i a becomes a total 
derivative: 

<5-t?n-p-l a//\dS = dBn-p-1 a/AdS-i (66) 
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If we take (ii), the terms include at least one -B n _ p _i a . Then if Si has no terms which include 
only one B n ^ p ^i , the total BRST transformation of A p a at the boundary becomes 

SA v a // \ gs = dA p a // \ gE . (67) 

On the other hand, one of B n _ p _i a becomes a total derivative: 

£Sn-p-i o//|as = dB n -p-\ a //|as- (68) 

Now we assume that Si is constructed from terms to satisfy the condition above. Then 
we define 

®F,pi,—,Pk,qi,~m// 

= E (F P1 ... Pk , qi ... gi (A a ) -A p r ■ ■ -A Pk a * -B qibl ■ • -2U)//U (69) 
We can confirm that 

^F,px,-,p k ,q u -,qi// — ((S, ^pi,-^,^,-,^//)) = d^F,p u -,Ph,qi,-Ml 7 '• ( 70 ) 



Especially 



where is the 0-form part of O. Therefore Op\ „ „ „ is a local observable with ghost 
number \0\ — Pi + - — \~Pk + Qi + • — h . We can also construct Wilson-loop-like observables 
on the boundary manifold <9£. 

^F,PU-,Pk,qi,-,qi// ( 72 ) 



where S r C <9£ is a r-dimensional closed subspace of <9£ and < r < \0\. Actually 
ft BV / Sr &F,pi,-,p k ,qi,-,qi// = because of the equation (|7C|). 

We consider simple cases. J^ r A p a ^ is an observable from (|72|). If we take (i), it is trivial. 
If we take (ii), it is an observable with ghost number p — r. J Er 5„_ p _i a , , is also an observable 
from (|72|) . If we take (i), it is an observable with ghost number n — p — 1 — r. On the other 
hand, if we take (ii), it is trivial. We consider an another example: 

O F = F(A a )\ ds . (73) 
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O-form part Oy of O f is an local observable at the boundary with ghost number zero. 
The generating functional is defined as 

Z[O k ] = [ fl VA p VB n ^ x e t(*+£r-W (74) 

where are source fields and 0^ are observables. In two dimension, the correlation function 
of two local observables Of and leads the star product formula: 

/ * g(x) = [ V4>VB X Of (0(l))Of (^(0))ei s , (75) 

•/ <j>(po)=x 

where ^ = A a and 0, 1, oo are three distinct points at the boundary <9£. We can propose a 
generalization of the star product to higher dimensions as follows: 

m k [0 1} 2 , ■ ■ ■ , O k ] = J fl VA p VB n ^ O x O % ■ ■ ■ O k e* s , (76) 

p=0 

under the appropriate regularization and the boundary conditions, where S is the defor- 
mation fl3T|) of the n-dimensional world volume BF theory and CVs are observables at the 
boudanry. The correlation functions satisfy the Ward-Takahashi identity derived from the 
gauge symmetry: 




where O is an observable. The WT identity leads L ro structure on the correlation functions. 
Therefore the product ( |76| ) has the structure. In two dimension, L^-algebra structure on 
the star deformation is certainly derived from the L^-algebra structure of the BRST algebra 
0. We can generalize the structure to higher dimension as the WT identity on correlation 
functions of the higher dimensional BF theory. 



6 Topological Open Membrane 

We consider the theory on the n — 1-space-dimensional open membrane in ^-dimensional 
target space. The open 2-brane theory with the background 3-form is analyzed at the paper 

i0B 
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First, we consider the topological membrane theory action with a background n-form field 
C as follows: 

S= I C av .. an {<f>)d<f> ai ---d(f> an , (78) 

there C ai ... an is a completely antisymmetric n-form. We rewrite the action (|78| ) by first order 
formalism as follows: 

S = [ a d<p a + a A 1 a + C ai ... an A^ ■ --A^, (79) 

where A\ a and B n _i a are auxiliary 1-form fields and n — 1-form fields. 
In two dimension, the action ([73) is written as 



S = ( B l a d<p a + B l a Af + C ab A x a A 
= j^B la d<p a - l -(C- 1 ) ab B la B 1 



b 

l ) 



+C ab (V - liC-'rB, c ) (V - ^(C- 1 ) bd B l d ) . (80) 

If we set Ai a ' = Ai a — i(C _1 ) ac -B c and integrate out Ai a ', we obtain the action of the nonlinear 
gauge theory in two dimension (|). 

In higher dimensions than two, we can obtain ( ff9| ) from our deformed action (|37j ) by the 
following procedure. If we take the limit 

Bn-p-l a — > for p ^ 0, 

A p a — > for p > 2, (81) 



we obtain (79), where <p a = A^ and 

Fl,n-1 a" = Sa\ JU, ^ = (-1)^.^(0). (82) 

The topological open membrane is derived as the above scaling limit of the deformed BF 
theory. 



7 Conclusion and Discussion 

We have considered all possible deformations of the BF theory in any dimension by the 
antifield BRST formalism. We have analyzed the BRST cohomology of the BF theory. It has 
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led us to a new gauge symmetry and a deformed action. We have considered quantum BV 
formalism and quantize the theory. We have taken the gauge fixing and found observables. 

This gauge symmetry gives an extension to higher dimension of the nonlinear gauge sym- 
metry in two dimension, in three dimension. We have considered our theory as 
higher dimensional generalization of the two-dimensional nonlinear gauge theory, or the Pois- 
son sigma model. It will be useful to analyze topological open membrane or noncommutative 
structure on higher dimensional open membrane. In fact, we have considered that our action 
tend to the topological n — 1-brane action at a certain coupling zero limit. 

Our key structure is Loo-algebra. Generally, the gauge algebra can be consistently de- 
formed to the Loo-algebra (the strongly homotopy Lie algebra) in the antifield BRST for- 



malism [ 17j |T8[ . On the other hand, Loo-algebra is the underline algebra in the deformation 
quantization or formality conjecture ||. Loo-algebra structure on the star deformation is 
certainly derived from the Loo-algebra structure of the BRST algebra at the path integral 
representation of the deformation quantization [[|. Our extension has respected the similar 
Loo-algebra structure. 

We can conjecture that if we consider the deformation (|37D of the BF theory on the 
open membrane, the operator product expansions of the correlation function at the boundary 
are deformed and ( |76|) is a deformation of n-algebra |24j]. The explicit calculations of the 
correlation functions are needed on the quantum theory. 

In the Schwarz type topological field theory, such as the BF theory, observables are related 
to miscellaneous topological invariants and knot invariants [^5[ [^6| . In our theory, geomet- 
rical meanings of correlation functions of observables are not still understood. More generally, 
whether deformation of correlation functions of a gauge theory is related to deformation of a 
mathematical structure or not is not still known. 

Topological field theories called A model and B model are introduced to investigate the 
mirror symmetry [ 57| . Different reduction of the topological open membrane theory leads us 
to the A model and B model p2| . Our theory may be useful to analyze the mirror symmetry. 
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Appendix, Notation 

For a superfield F($>, $ + ) and G($, $ + ), The following identities are satisfied: 

PQ = /_^\gh-FghG+degFdegG^^ 

d{FG) = dFG + {-l) dcsF FdG, 



(83) 



at the usual products. The graded commutator of two superfields satisfies the following 
identities: 



[F, G] = _(_l)ghFghG+degFdegG[ G;F ^ 

[F, [G, H}} = [[F, G] 1 H} + (_l)ghFghG + degFd e gG[ G) ^ 



(84) 



We introduce the total degree of a superfield F as |F| 
product on superfields as 

F ■ G = (-l) ghFdegG FG, 



ghF + deg F. We define the dot 



i5) 



and the dot Lie bracket 



\ghFdegG 



[F,G\. 



(86) 



We obtain the following identities of the dot product and the dot Lie bracket from fl83f ), (0), 



and (H): 



F-G = (-1) |F||G| G-F, 



|f||G| 



IG,F], 



{F,{G, Hjj = [[F ,G],H} + (-1)™ {G,{F, H]] 



i7) 



and 



d{F-G) = dF-G+ (-1) |F| F ■ dG. 
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